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ABSTBACT 

Preparatory to developing a curriculus for parents to 
use in teaching children hov to evaluate the reality and 
applicability of television in their lives, interviews vere held vith 
IS^-year-olds and 16-year--olds and adult whites, blacks, and Puerto 
Bicans around Boston to deter sine the processes they used to sake 
such discriaination. The sethcdology of the interview is described, 
and representative answers fros various respondents given* The coding 
■ethods and cross-checking systess are explained. Prelisinary 
analysis of the responses is given, and contrasts between adult and 
ll^year-old espouses are listed. Plans for future guestioning of 
children, aged 4, 8, and 12, are described, along with plans for 
developing the proposed curriculus. (SK) 
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I'd like to begin today by relating to you seme of the coHienta we have 
heard as ve have talked about television with black, vhlte* and Puerto Rlcan 
adolescents and adults in and around Boston. Let*s start with one person 
Who told us that considerably less than 30Z of entertainMnt prograaiilng vas 
true-to-*life or worth knowing. In explaining why It was so low, he answered: 

Basically lt*s the attitude of the people In charge of the 
ttedla. I think they just want to get large audiences. They 
feel that just a small percentage of people are interested in 
sore serious, factual, true-to-life, whatever you want to call 
it. They •re just not interested in that. They just want 
audiences. The other thing is if it*s going to be a national 
program as opposed tc a local program, they have to cater to 
even larger audiences. There again it would create even core 
mediocre programming. 

Another Interviewee, however, had a very different understanding of the 

reality of television. He thought that nearly 70% of entertainment pro- 

granslng was true-to--life or worth knowing, because: 

you know, I think television is pretty true-to-life and it^s 
Just you go home and watch the same things that you know 
about that go on in life. So without it you* re not really 
missing much. 

These people had general opinions &bout how much of entertainment 

television is true-to-life or worth knowing. People also have opinions about 

particular content areas. For example, one white woman told us: 

I don't know much about it, but it «ieeB4S that all the black shows are 
all the same. It seems that they're showing all the black people in one 
way on almost all the shows, so maybe this is true.... I think the white 



people are true-to-*llfe and the black people mist be true-to-llf e • 
I don't know much about then, but all the shovs show then and have thea 
act the saae way. But as far as the white people, I know they try to 
■ake them true-to-llfe so people can sympathize with them, 

A black man had a very different opinion about the ways in which black 

men are portrayed on talevlslon. He said: 

Totf sure hit a sore spot now. I think lt*s absolutely terrible. 
And one show in particular is Good Times. I think his portrayal is 
terrible. I think it*s Just a downgrade for the bla*^ man. It depicts 
him as not being overly ambitious. He comes on, he doesn't come on 
in a manly way» to me. He comes on sort of like a gorillsy and I think 
this is what white people expect black men to be* like gorillas. 

This contrasts sharply with the opinions of the white woman we talked to 

and with the black man's own estimate of the portrayals of white women. 

He said: 

I'd say pretty good... you know, they're sort of flighty. I'd say it's 
a very good portrayal. 

C o mm en ts like these appear often in Interviews Sherryl Graves. Neal 
Gordon, and I have been conducting during the past nine months. These 
interviews are the first in a series of steps leading to a curriculum 
for parents to use in teaching their children how to evaluate the reality 
and applicability of television to their own lives. Television presents 
children with much antisocial behavior » stereotyped portrayals of %iomen 
and minorities 9 and exhortations to purchase products. This content can affect 
the behavior » attitudes* and expectations of children. We believe that children 
may be able to modify the effects of exposure to some of this content by 
becoming more critical consumers of it and that parents can help them to do 
this. Thus we have embarked on three years of work to test this belief. 
Our objectives have been: 
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1. To discover the processes children us^, or could be taught 
to use 9 to discriminate the applicability to their own lives 
of varieties of television content* 

2. To develop techniques which allov parents to teach their young 
children to use the processes Identified in the first objec- 
tive. 

3. To dewmstrate that children who have been taught these processes 
will use thea to discrininate iihlch television content is ap- 
plicable to their lives y resulting in changes in the extent to 
vfalch television content influences thea. 

Today I will discuss prellnlnary findings from the phase of the research 
in Which ve attespt to discover the processes adolescents and adults use 
to discrisinate the applicability of television to their lives. To do so 
%ie have conducted 58 clinical interviews with thlrteen-^ear-olds, sixteen- 
year-olds, and their parents. We atteapt to gain as auch Inforaation as 
possible about the ways In which people decide what on television is true or 
applicable to their lives. This inforaation will be used to shape our 
Interviews with four-, eight- » and twelve-year-olds and to guide our choice 
of critical evaluation skills we will subsequently teach thea. 

As the selections you just heanj Indicate , we Interview white, black, 
and Puerto Rican residents of coBDunities in and around Boston. In so far 
as possible we have tried to work In coonunities in which all three ethnic 
groups reside. When that has not been possible ve have, first, looked for 
coMunities in which at least two of these groups reside and have» second, 
attaqited to select representative saraples of each group extending across 
the entire range of social classes. The interviews are conducted in the 
subjects* homes or in school buildings. Each person is interviewed by soaeone 
who belongs to the same ethnic group. The interview is conducted in Spanish 
if a Puerto Rican subject wishes* Each interview lasts about 45 minutes, is 
tape-recorded, translated if necessary, and then transcribed. The transcripts 
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are blocked into units vhich roughly correspond to paragraphs of content and 
then coded in a sentence by sentence analysis. 

The Interview was developed over a period of four nonths. During the 
stflBier we pilot-tested various interview fomats and questions. Each was 
designed to give us as msch information as possible about how adolescents 
and adults decide what, of all the content they see on television, they will 
believe and/or consider applicable to their own lives. At the end of the 
suOBer we conducted another series of Interviews, carried out preliminary 
coding on them, and revised the interview for a final time. In November we 
began to use this interview for data collection. Let me give you a few 
examples of the kinds of questions we ask. We begin by defining entertainment 
television and asking "So, in general, what do you think of entertainment 
television?" Answers, of course, vary from such statements as "no comment" 
to "I think it*8 good. If you don't have nothing to do, you can always go 
and watch TV^'' to long dissertations about what's good and bad on television. 

There follows a whole series of questions designed to elicit information 
about how people decide what is true-to-life or worth knowing on television. 
For example: 

How true-to-llfe do you think entertainment television is in general? 
Why do you say that? 

Have you ever found yourself doing or believing something and realized 
you got it froiu watching entertainment television? 
What do you suppose led that to happen? 

Have you sometimes gotten ideas from television which you latter found 
out were false? 

Why do you suppose that happened? 

Bow do you try to keep yourself from making such a mistake and believing 
a false idea shown on television? 

What do you think is th^^st true**to-life program you have seen on TV? 
What about it is realistic? 
Why do you feel it is realistic? 
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Suppose a child asked how he or she could tell when something on 
television was true and when It wasn't. What would you say? 
Could you give any rules that %#ould help the child. 

Answers to these questions and other slirllar ones Include statements like 
the ones I quoted at the beginning o£ the paper and many others which I 
will relate In a few minutes. 

Toward the end of the Interview we ask about the person's knowledge 
of the tex^vlslon Industry, their interaction with others about television 
content, and their awareness of stereotyped television portrayals of sex-roles, 
race-roles, and styles of Interpersonal interaction. Let me give you two 
exaiiq>les of the extent to which people seem to understand the television 
Industry when we question them about it. The first comes from a thirteen- 
year-old black girl. She felt that entertainment programs we^e put on the 
air "to entertain" and that money played a big role in television because 
"actors want more cash, everybody wants more cash, if they don't get the cash 
they quit." When we asked her whether the fact that actors wanted money 
affected the reality of a program, she replied "Um, yeah, yeah, yeah, 1 do, 
1 do." Then she explained "...like on Hawaii Five 0 or Police Story and there 
is a syndicate, and they argue a bit, and they really, you know they are really 
getting cash and all that, they want to get cut in for more, and 1 want you co 
murder somebody for a lousy two grand or something like that. They want more 
money." 

An adult male, on the other hand, told us that certain programs were 
broadcast because: 

"They're looking for the most viewers. So they're going to put them 
on in the times when they think the most people are watching, so they 
can sell their products. Even Ch^nnel 2 (the PBS station in Boston] 
they aren*t selling products, they're still going to gear their programs 
to the times when the most people they think are interested are watching. 
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The disparity between his view of the television Industry and the thlrteen- 
year-olas Is apparent. What Is not apparent from what I have said Is that 
this Ban Is the most knowledgeable person we have Interviewed. Most adults 
do not have a very complete understanding of why entertainment programs 
are produced and broadcast. 

We !iave assessed the time-to -time reliability of the interview 

with three people and found that the information given at a second la- 

at 

terview was almost the same as that given/ the first. The interview it- 
self was somewhat shorter and the absolute amount of relevant informa- 
tion somewhat less, but the pattern of responses was not very different. 
We have also assessed validity by examining the face validity of the 
Ir'^arview and the responses to it, by conparing the responses of adoles- 
cents and adults, and by conparing the responses of graduate students 
considered to be more and less knowledgeable about television production 
and the industry itself. In all three cases we found that the interview 
provided info. nation relevant to our goals and that it discriminated 
between people who we felt on an a priori basis should respond differently. 
Thus we are reasonably comfortable with the clinical interview format, 
although we have built into our study additional, more experimental 
validity checks on the information we have ojtained. 

Interview transcripts are coded in two ways. In one estimates of how much 
of entertainment programming is true-to-life or worth knowing, knowledge of the 
television Industry, interaction with others about television, estimates of 
stereotyping on television, opinions about the effects of television on others, 
and general evaluations of television content are coded. Another coding provides 
the information which we are most interested in. This coding focusses on all 
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statements vhlch reflect how people decide what they would believe and/or 
remeober about what they saw on television and the parts of a program they 
select In making these decisions. After testing out many«systems and 
examining the Information obtalnf>d from each one and the Intercoder reliability 
possible %dth It, we have arrived at one which divides Information Into 
five main categories which will be presented later In the paper. 

Intercoder reliability on this system has been assessed frequently 
over the last few months. We have found It possible to achieve very 
high reliability in some instances , but we have not been able to main- 
tain consistently high reliability. Our reliability figures fall into 
three areas: (1) For whether or not to code a sentence, agreement has 
ranged from 71Z to 91Z, (2) For all codable sentences, agreement has 
ranged from 26Z to 68Z, and (3) For coding category assigned to any 
statement both coders agreed was codable, agreement has ranged from 
%5X to 93Z. Because of the variability in our reliability figures, 
we currently have each interview coded independently by two 'ilfferent 
people who Che*^ meet to resolve their disagreements. This process 
then yields the data which we will finally analyze. 

Data analysis has so far been quite preliminary, although we will 
soon do a computer analysis which will let us look at the Impact of 
various background variables on the way in which the subjects evaluate 
television content. We will also be able to understand better the 
ways in which the subjects think about the topic of applicability adJ 
to relate the structure of the interview to the actual content pre- 
sented. 

The preliminary analysis Includes sixteen interviews , evenly divided 
by black and white, male and female, and thirteen-year-olds and adults. 



Needless to say this Is just a glance at the kinds of Information ve may 
encounter In the full sample. We have focussed nov on differences in 
the ways In which thirteen-year-olds and adults evaluate television. 

In general, adults talk more during the interview than do adoles- 
cents. This holds true whether one cor^pares the number of pages in the 
Interview (adults, 8,25 pages; adolescents, 7.5 pages), or the number 
of sentences in the interview (adults, 173.6 sentences; adolescents, 
151.9 sentences), or the number of sentence? specifically related to the 
issue of applicability elimlna"'ng sentences referring to background 
information (adults, 137.4 sentences; adolescents, 112.4 sentences). While 
these adults are more talkative than the thirteen-year-olds there is no signi- 
ficant difference in the number of codable sentences for each group. On the 
other hand, the thirteen-year-old group produce twice as many ambiguous 
sentences, or sentences that cannot be coded into a category, than do adults 
(adolescents, 3.7Z ambiguous sentences; adults, 1.9Z ambiguous sentences)* 

Our next coding step has been to look at statements which reflect 
decisions about what is true-to-life or worth knowing on television and 
statements which reflect the processes by which these decisions are made. We 
found that people rarely relied on their affective responses to program content 
or on aa overall evaluation of the credibility of television programming in 
deciding what is true-to- life or worth knowing on television. Instead, about 
half the time they relied on cues contained within a program such as who the 
actors ^re, quality of acting, the type of program, specific programs, sets, 
costumes, plot line, Indlvlduai actions, and production techniques. The other 
half of the time they explicitly compared program content to information sources » 
outside the program such as their own knowledge of programs, television 
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personalities t and the television industry and reference to their own 

experience, conceivable experience, and Information given by recognized 

authorities. Let me give you a fev examples of these two major areas: 

One sixteen-year-old girl told us that doctor shows are "Interesting 
because I know that the terms that they use and the things that they 
say are all true, you know, they check with doctors first. And I always 
get a lot of Interesting facts from shows like that, you know, things 
that are true and stuff," 

She apparently uses program type as a guide to truth, as well as her 
understanding that scripts are checked by doctors prior to broadcasting. 

A thirteen -year-old boy told us tlict iasiilj Affair was the most 

realistic program on television. V/hen asked to explain what made 

it realistic he answered "see it has an apartment, it has the kids and 

their friends and everything going to school and then the playground and 

everything." 

He apparently uses the characters, their activities t and the settlag 
to help him decide what is realistic. 

It can be argued that both these adolescents are actually relating television 

content to their own experiences and knowledge outside of television, but there 

is very little evidence for it in their statements. At other times adolescents 

and adults are more explicit in making these relationships. For example, 

one thirteen-year-old boy us how he decided when something was true- to-life: 

Well, if it is then lt*s something that's typically family life, or 
something my family probably would do, or somethln I would do or my 
sisters or brothers. 

Adults and thirteen-year -olds determine applicability using cues 
within a program in a similar way and to a similar extent. While 
adolescents use cues within a program 5h.72 of thi time adults use these 
same type of cues 50 .7%. The specific cues that are employed by both 
age groups are very similar with one exception: 13-year-olds rely on 
production techniques like flashbacks, slow motion, and zooms 3.8Z of 
the time while adults use them only IZ of the time« Let me give you an 
example of this by quoting the advice a thlrteen-year*^ld boy would give 
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to a younger <^lld; 

Vd tell then to look for, first to look for the phony stuff, right. 
The shots* Because In the movies and acting and real life they don'c 
always shoot the person. I'd tell him to keep his eye open for that* 
And I*d tell him to watch for like cords cause you can tell In that 
McDonald's commercial, I know that's fake, I can see the cord picks 
him up, I'd tell him to keep his eye open for anything that may be 
hooked on to the person, make him fly. Like in Superman, what he is 
is like laying down or something and probably the scenery going 
backyards. He's like this wheel going around in circles cause it's 
the same thing. 

Except for production techniques, the two age groups utilize the remaining 
cues within the program in a very similar way. 

Uben we look at the comparxson processes that subjects use we 
focus or. the explicit relationships the subject makes between what 
goes on in a program and what the subject knows from sources other than 
the program. Comparison processes represent 47, 5Z of all codable state- 
ments for adults while they represent 41Z of codable statements f^r 
thirteen-year-olds. The most significant difference I ;twcen the cwo age 
groups is their use of comparison processes in the area of Industry 
Knowledge. Tnls category includes all statements which refer to knowledge 
about the commercial nature and audience size orientation of the indus- 
try as a basis for deciding true-to^llfe or worth knowing. L<it me give you 
one example: 

And I think any program is always giving the opinion of the person who 
either wrote it or produced it. So if this person goes into a country 
to do a documentary on it, and he really loves that country, he's going 
to do a very good job gearing it to that country. Where again somebody's 
sent in there who doesn't want to do it but there's a buck in it for him, 
he'll throw anything into it and send it back and you watch it. The 
opinion we get out of it is the opinion of the person who produced it • 

Nearly 13Z of adults* codable statements refer to industry knowledge while 

only 3^Z of thirteen-year-olds^ codable statements referred to Industry 

knowledge. This finding is interesting because it suggests that one of the 
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things children could be taught more about In our later work is the way In 



vhlch television as an Industry operates* 

Finally we compared the way In which adults and adolescents associated 

comparison processes with specific cues within a program, it seems that 

adults use comparison processes in a more general vay« For exaicple, 

adults were likely to say such things as: 

Welly the only way I can decide that is from my own knowledge and 
what 1 know and how 1 live. 

Welly 1 think if you know that it could happen you think it's true-to-life. 

Usually from my own experiences. 
Thirteen-year-olds, on the other h^nd, are more likely to tie the comparison 
process to a specific aspect of the program when trying to decide what is 
true- to-life and worth knowing. For example, thirteen-year-olds were 
likely to say: 



Well, on (The Odd Couplej there's a guy who's really messy and everything^ 



1 don*t know, but there could be a person who does that but 1 really 
doubt it. 

When it's realistic, like if you seen something happen in real life, like 
soaiebody ripped off something in a store. And ther you see that on TV, 
you know liK3 — you're picturing yourself back on the spot that you saw 
somebody stealing something and the guy yelling at somebody. 

In the preliminary sample comparison between adults and thirteen- 
year-olds we see differences: (a) in the amount of talking in the inter- 
view; (b) in the number of ambiguous statements included; (c) in the 
use of industry knowledge as an applicability cue; and (d) in the associa- 
tion of specific parts of a program to comparison processes. These 
variations seem to reflect expected developmental differences between 
adu?t8 ai«d adolescents. They generally reflect a greater range of ex- 
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perlence on the part of adults than on the part of the thirteen-year-old 
group. We expect that our work with younger children will follcw 
a similar pattern, with young children on .more specific cues 

from a program. 

This preliminary data analysis is our first effort at understanding 
the various ways in vhich people decide what they will believe and/or 
remember from entertainment programs. Vhen ve have completed our sample of 
72 people and a fuller computer analysis of what they say, we will be better 
able to understand how the issue of applicability is dealt w^th by thirteen- 
year-old, sixteen-year-o*!a, and adult, black, white, and Puerto Rican, 
males and females. 

In the next two and a half years we will try to understand how four-, 
eight-, and twelve-year-olds deal with this same issue, to teach them 
techniques which seem to be within their grasp and yet more effective than 
the ones they currently use, and to help their parents to teach them. If 
we have been successful in identifying the skills that are really critical 
to evaluating entertainneat programming and in finding ways to communicate 
these to children, then these children will be more critical consumers of 
television content. If so, ve will have helped them to deal more effectively 
with their world. 



